-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add iris-grib to dev dependencies #980
Conversation
Okay, maybe not. But it worked when I tried it manually? The difference here is that when resolving manually it went via artifactory, while building from the lock files goes to anaconda.org. But then how did it work from Firefox. It works on GitHub Actions resolving from the same lockfiles, so unless GitHub have overwritten the DNS location of anaconda.org, we should be trying the same request. Other .conda files can be downloaded from anaconda.org, including eccodes releases. Eccodes does seem particularity slow however. I suspect it is exceeding the 60 second timeout. TheorySomething is funky about the eccodes package on anaconda.org, causing the anaconda.org server to have to do a bunch of work to retrieve it. This work takes longer than 60 seconds, so the HTTP timeout on conda times out, and the package fails to download. Artificatory is not affected as it will have its own backing store. Actions
|
Installing with increased timeoutAs best as I can tell the timeout is hardcoded. I guess we could hack our conda install just to test? Or see if mamba or pixi give more options. |
374fb3b
to
7777901
Compare
I think this is a web proxy issue, and I've opened INC000263814 to try and get some logs from there. |
To work around this issue the conda timeout can be increased:
|
07d52a9
to
45f8973
Compare
Looks like 2.40 has been released (https://anaconda.org/conda-forge/eccodes/files), so we can test this again to see if this works. |
3c6d7f5
to
33b989f
Compare
Testing again, conda still times out unfortunately. (Only two seconds over the threshold now though...) One can set the remote_read_timeout_secs to get it working, but it seems broadly the same as the last version. If I had to guess, I would suspect there is some virus scanning process happening inside the web proxy that is getting stuck on this file, then timing out after a minute. This may not be entirely surprising, as the eccodes package contains about 25000 files. |
It works at least! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice, we'll keep an eye on it and make sure it doesn't cause problems again. It'll be great to have this in to support grib and ML models.
It seems that the eccodes download issues were just temporary, so we can now re-add it.
Fixes #959
Contribution checklist
Aim to have all relevant checks ticked off before merging. See the developer's guide for more detail.